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^achievement in learning specific mathematical ideas/ Ihe experimental 
•scoring method (U* scoping) ^ which" aliens learners to obtain^bOnus 
points for constructing more complex solutions ves introduced into 
year-long instructional gaaing tournaments in tuo. classrooi^si a 
seventh-grade class in an inner-^city school and an eighth-grade class 
in a suburban university-community school,^ The results in the 
experimental classes vere compared with those in corresponding 
classes taught by the same teachers in which the. conventional scoring 
method vas^jised. The mean difference in pretest/posttest results vas 
nearly three times as great in the experimental class as in the - 
control class In ^Tie eighth-grade group^ and irearly double in the 
se^nth-grade group. The results seem to ha fe, implications for the 
pofential for improving learning processes by channeling attention 
appropriately* (Author/VI)^ / ' / . 
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WHAT COUNTS IN HOW THE GAME IS'PLAYEO: INCREASING ACHIEVEMENT. IN 
LEARNING MATHEMATICS BY CHANGING- THE SCORING IN .AN 
INSTRUCTIONAL GAME* 



' by '.. • ' ■ V 

Layman E. Allen, Gloria Jackson, Jo A Ross,^ and Stuart .White • 

University. of Michigan * * . 



Prior investigations have indicated that instructional gaming has 
strong effects in enhancing motivation' and a'chievemerit in* learning 
mathematics. In this study two experiment?, indicate that modification of 
the method of scoring in the EQUATIONS game further enhances achievement ■ 
in- learning specific mathematical ideas — more than do'ubling the mean , .• . ' 
increase in tQSt results. The experime*ital scoring method (44- scoring) 
was introduced into year- long instructional' gaming tournaments in two - 
.classrooms: a seventh-grade class^in an "urban inner-city School and an . 
eighth-grade'.class in a suburban university-community school. The 4-f 
scoring is & relatively minor flipdif ication of tlflN convei^Cional scord,ng 
method; it allocs learners to obtain bonus points" for ponstructing more 
complex solutions in -the tournament play. The result^ ,in the experimental _ 
classes were' compared with those, in other correspo^ain^-lev.eX classes taught 
by the same teachers in ,which the' conventional seorih^i method for EQUATIONS 
tournaments, was used." The mean difference in. pretest/pdsttest-.resul-ts was 
nearly three times'as great, in the experimental class as in the oontt^l class 
in the eighth-grade group ^n^.near^ly dofible in the seventh-grade group ♦ The 
magnitude of ttie relative diffiprence in -achievement elicited by such seemingly 
■.minor modification of procedure IS'Jurprfsi^g. It -1,^ grounds for optimism 
about the potentialities for impro^^ing learning, processes by channeling 
attention appropriately.' s - ' ' . ' 
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* To, be published In Proceedings; of the'lAth Annual" Symposium, National 
/ GaMng Cou'ncl^.Xos Angeles, California, Decetaber 1975. ^ 



^WHAT COUNTS IS HOW. THE &AME IS PLAYED: 'EFFECTS IN INSTkBCTIONAL GAMING ' 
OF CHAfJGES IN SCORING- UPON LEARNING ACHIEVEMENT ' " 

. • Laymah E. Allen, Gloria Jackson, Joan-'Ross; and Stuart White 

University of Michigan • * 

INTRODUCTION ^ ' ' ' ... j 

Prior investigation indicates that' instructional gaining can be an - 
effective tool for enhancing "both motivation and achievement in the 
learning of mathematics. This study explores the extent to which 'the 
'effectiveness -of instructional gaming in facilitating the learning -of 
specific mathematical ideas -can be increased by incorporating devides -that 
chai^el learners' attention upon thoge ideas. ' In particular, the effect 
of channeling attenti'Sft by changing the method of scoring is explored. 

Background ^ • . . 

.Research on the use of kA-type (Resource Allocation) nonslmulation 
games (Allen, 1972) began in the early 1960's with the first of -this '-type 
of game to be published — namely, WFF 'N PROOF: ' The Game of Modern - 
Logic (Allen, 1961). Initial results showed "that an intensive exposure 
to the WFF-'N PROOF material^ in a classroom toum^ilent was accompanied 
by significant increases .in the scores of participants on the nonlanguage 
part offStandard I.Q. tests _ (Allen, ^Allep & Miller, ^566; Jeffries, 1969); 
the -mean Increase in one study wae more than 20 points (Allen~ AlW & 
Rpss, 1970). Subsequent- Investigations with a game designed for. facilita- 
ting the. learning of mathematics — EQUATIONS: The' Game of Creative 
Mathematics (Allen, 1963) ^ showed that Its' use 1^ 'a d^foom tournament 
setting was accompanied by significant increases indardicators of mStft- 
vatlon and achievement. Using student ab5Senteeisnfas» a 'pervasive' md 
pragmatic , indicator of mptivati,on in the sen^of stydent ^attitudes toward 
'^'^•^'w^"*^"^ environment of th^' mathematic^ clasisroom, 'rg^sults* of a year^- 
long study in a Detroit- inner-clby schpdl showed that the rcBap. absentee 
rate in classes employing Instructiortal gaml'ng in a tournament -structure 
was significantly less than (les^ than 9ne-third) the corresponding rate 
i\i control clashes (Allen & Mairt, 1973). Using , observations- of student- 
behavior, stude\;its' reports of /their relationship^ with classmates , atid 
students' reports of the classroom envli:£>nment as 'indicators of •various - 
aspects of the total classroom proQess , • DeVrles. and Edwards (1^73? repprt - 
that mathematics classes usln^ Ins true tjojial. gaml'ng tournements had > 
significantly more peer tutdrlijg an,d that st,u4ents percelyed the class , 
as significantly more statisfying,"- less difficult, and less competitive' 
than sttfdents in control, classes^ The sam^-, lnyes,tigatdrs al^o' found 
indications of greater s^ciaL i'^egration in lnstruct;ional gaming classes 



'.than in' other classes; thete ^*as significantly more cross-race .and cross- 
, sex- Interaction (DeVries & Edi^ards, 1972). , Perhaps not surpjrisi^^^/ in 
the same series of studies there were signif icarrtly greater gains in 
mathematics achievement as indicated by Stanford Achievetnent Test and 
a speciallyrconstructed divergent solutions t^t on the part of those 
classes engaged in Instructional, gaming that expeti^nced .these more \ 
positive socia.l and motivational .effects than in the control classes ' 
(Edwards, DeVries & Snyder, 1972). There had been earlier indications 
of increased gains ,in mathematics achievement accomp^ying the class-room 
tournament Hse of the EQUATIONS^ game; four months of Instruction using 
gaming resulted in an average increase in arithmetic reasoning of 1.3 
"'yearp, .seven- months more than the average gain In the control class 
(Eger^oi;!, 1966) . Subsequeht studies tend to confirm, that strong effects 
upon achievement result when the instructional gaming' experience is 
accompanied by attention- channeling techniques that focus attention upon 
specific mathematical excepts. One of these techniques uses a solitaire 
version. of EQUATIONS with. printed pamphlets called IME (Instructional 
Math Play)* Kits; they simulate a computer playing the game as an effec-. 
tive teacher of a specif ic. concept (Allen & Ross, 3,971). S'tudents who 
used the IMP Kits during .five class periods over a two-week period 
sustained significantly .greater gains (doubled their performance scores) 
than did students who were otherwise presented the same content in 
control classes on tests containing extreme-ly difficult problems (see 
Appendix A for examples) on concepts presented in the IMP Kits (All^n & 
Ross, 197'4a; Allen^^ Ross WyAb)'. HoxA'ever, no significant changes 
occurred In either the mqtivational or achievement dimension when the 
EQUATIONS^ g^e , was used for a shorter period, without the cooperative 
features of the -learning environment introduced with the games, and 
\p.thout the tournament, procedure, which 'is designed to individualize , 
the problems presented to "feach leameV and to equalize the reinforcements 
Vhieved ^ong all members of the class ^(Henry, 1^73). 

Channeling Attention Upon Specific Mathematical Concepts 

* The basic game^ of EQUATIONS allows participants virtually complete 
freedom in^ determining which of yarious elementary arithmetic l^ieas ttiey 
will deal with, fcut it can easily be modified to focus -attention upon ^ 
specific id^as. The game is played by two or more persoitiS^" with the v 
objective of finding ways of expressing equations by using simple arith- 
metic-operations and numbers. One play'er defines the Goal (the right-side 
of an equation) by selection of some of -the numbers and operations . 
provided by a roll of a ^dozen or rfcre .special dice. The players then '\ 
try to^come as close as possible to supplying the left side of the equation 
(th€^ Solution) VLthout atctualli^ doing so, by moving' one die "at a Irime from.* 
the remaining .dice. If a mover get^ too close to a Solution or prevents 
all Solutions* (by eliininjating crucial dice from play), thfe othel: pl-ayers 
have an opportunity to win by challenging the err ant. 'mover*. , All completed' 
ECjUA^IONS games end with some (non-null), subset of the players having ^: 



the burden' of proving that thj^re is a Solution: equal to jjhe Coal that * 
can be built from a constrair^ed set of digits -^and operators ♦ They score 
points if and only if they write such a Solu|::i6n» Those who»do jiot have 
the burden of proof score points if and only if nobody writes a Solution* 
In'Ba^ic EQUATIONS ^^he characteristics of the Solution^ written are omiin- 
pprtant with respect to the scoring* A player can write easy Sblujtlons 
or ones containing difficult ideas, and* neither will make any diff^ence 
in his or her scores* The score of a player is independent of the degree 
of difficulty of the mathematics used in writing a Solution. To th^ 
extent thatt there' is incentive to players to learn more sophisti^cajt^d 
mathetiiatical id^s in B^ic EQUATIONS, it is proyided by the game struc- 
ture: those whose understanding is -deeper or whose knowledge 6^ content 
is broader are ^mo're likely to' win. Foj: a raqre Retailed 'account of 
EQUATICiNS, the classroom tournament setting in which, it is used, and the 
team organization for 'eliciting qooperative behavior, see Allen & Main 
.^73). • V ^ • 

jOne of the most^ powerful means, of extending the scope of the 'basic 
gamfe and channeling attention qn specific ma'thematical concepts' is .through 
a t^ariant of. the* gamfe called Aduenturous EQUATIONS. In this variation^ the 
pl^ax^rs become games designers as well as; continuing the* three 'Proles they' 
perform in tl>e basic game:* learners, teachers^ and diagnosticians. They 
crfeate nev/ games by adding rules tfo the basic-game, introducing o^her- 
mathematical Mfecepts by way of * tfie added rules'. For example, an adven- 
turous rule that "emphasizes the relationship between fractions and* 
decimals is: (a) When building a* Solution, a player inust' specify^ wheTe" 
the decimal point (s) occur in the Goal, but no dec^imal points are allowed 
in the. Solution. \|[ThiiS', * a' Goal of 2x3 can be . interpreted as 6, .6, or 
06.) Examples of -^dventurous rules that extend the •mathematical content. ^ 
of the pl4y are:, '(b) The *-c* die shall'not represent the subtraction 
' operation; instead it shall represent the log^ 6peration. (c) The die 



shall 'not represent the division operation; instead- i^ 
%the imaginary number i 



shall represent 

c 



\ A second method for channeling attention upon sjSeclfic mathematical 
'concepts is tTirough variations of 'the Playing Mat on \jhich the game is 
play^ed. For' example, instead of dealing only 'with equations ' invo lying the 

. equality relationship between two expressions as in Basic* EQUATIONS (i.e.^^, 
Sol tlon ^ Goal^ ' by ' changing the Playing. Mat the game can be generalized 
to^em^asize ofner relations. A Playing Mat with A / < B ^ 

j^ould ^phasize the "less't^an" relation, while a Playihg Mat with' 

— g — is* cJne-half of — g — . wo\lld focus attentioa'on the concept* of / 
ratio and- proportion yy means of the "is^^pne-half ' of" relation. The*; 
following Playing. Mat wduld structure a variant of EQUATIONS to^focus^ 
attention upon th'e pancppt of place-value by allowing players in moving 
tUe dice to require or perm^it other players to use numbers with various. 
place values: . v 





Forbidden 


) Permitted 


1 -Required 


Tenths Place- 


\ 




< * 


Units Pla.ce 


> 






Tens Place^ ; 


« 






Hundreds Place 

















A tKird method for channeling attention upon specific matheitfatical 
cpncepts is through puzzles associated with Various stages of play In the 
gama. For exaraplei^ the idea of dividing by* d fraction would be emphasized 
by the following -})uzzles:' Using just one die from the Rescfurces , as many 
as you wish from Permitted, all of those that are*Required, anj3 none of. 
those^from Forbidden, construct a^^lution thdt is equal to the Goal, with- 
ojit using any mltiple-digit numbers • " ' ' # . ^ 



Resources 
- 2 8^ 



Permitted 



Required 
1 4 • . 



Forbidden 



1 2 



•7 



Solution' Goal # ' 

Such puzzles oan be used to stimulate thought, in the classroom in a variety 
of way^: as a cooperative activity for the teams, as remedial work for 
individuals > or as homework pr otherwise for the entire class'. ^ 

^ ,A fourth method fox channeling attention ixpon, specific '^thematiQal^ 
ideas, one already known to be effective for increasing mathematics achieve 
ment, is ; play qf EQUATIONS by individuals using the IMP (Instmictlbnai 
Math^ Play) .Kltst The kits are pamphlet-^imulatio*ns of a highly-Branched 
(usually involving thousands of alternative pathways) computer-assisted 
instruction program, each designed ta make moves In's^ch a way as to - ^ 
direct -the user to Consider a specific ^thematical ''idea. (For-a^mote ^ 
detailed description of the IMP Kits,' see Allen & Ross, 1974a) • .For * * 
example*, in the following situation by moving^the + die io Forbidden *th^ 
IMP Program woul'^ extinguish .the obvious 4+5 Soiution-Pos'sibility^^and 
thereby ultimately lead the learner to^^ consider a Solution Involving the 
subtraction of 'a negative number (the idea It was dfe^lgned* to t^ach),: 



Resources 



Goal 



Experie^ice with the , IMP Kits clearly* suggests the importance of channeling 
attention on specX|ic );:ontent as well as the frequency and Immediacjj,, of . ' • 
•feedbac^c.as, factor^-contribyting to th^ effectiveness, of mathematif.Stj 
Ifeaming* , ' * ' o ' * 

. ' :A fifth method , for channeling attention /up<)n specific mathematical " • ^ 
ideas* -t- in' tjiis case ^jpon 'the more complex id^eas thajf'may arise 1%^ the 
course of play — is a method that theqe is very., little experience ^tb as* 
yet; it ^is a variant of the b^stc gamff called tlie^ "Snuffiag" Versle^, * In 
.this version a player can gain a*bon\is point on his*' Or turn by *^ia) - 
writing out a Solution-Possibility publicly for all >Jie other ^playejrs to 
see and then <b) making a move that "snuffs out" (^3^tdii|uishes ) -that ^ . 
Splution-Pbssibility. The introduction of -the snuf ifing'^rule Increajjes .the**^ 
feedback possibilities enormously atoong the players about Solution^. Involving 
different mathematical idpas. Instead *of showing eaph other a Solution 
only once — at the end of the play of a ^game wiien or\e. of the players has 
.the burden of proof as is' the jcase In Basic .EQUAXXONS ~'ln the^Sni\f fing 
version there is. incentive for players to' show a Solution to each other on 
every turn. It also shoUl^ hav^ the effect of getting ^ rid of the Solu-. 
tions that involve only relatively easy ideas early in the play <5f * a^ gam6-^ - 
and gently nudge the players in. later , play to explore more subtle* 
Solutions invoicing ideas that are more complex. Another effect of the • 
Snuffing version with its writing out of Solutions oil every move. Is that 
it seems to- slow down the pace of play, unless some compensating adjustment 
is made. * The pace of a play can be re-enlivened Sy having each player make 
two moves when it Is his or her turn^ instead of just ope. Still another 
effect of the Snuffing version, unless compensated for, is to decrease " • 
the Importance of -the play ^ at the end of the game; the regular scoring for - . 
achievement in sustaining the burden of proof -by constructing a Solution' .* 
is swamped by theNjrotnus scoring. It was in response to this difficulty 
that the 4+ Scoring*:Method was "devised*; it Is a» sixth method for channeli-ng 
attention upon^specif ic ^aathematical concepts and the method that is, 
investigated, in two intact-classroom experiments in this stUdy. In general 
it is a technique for providing .incentive to learn more mathematical^ ideas 
bji making 'tixe players^ scores depend" upon the quality of the Solutions 
offered: T^e more complex the ideas, used in a Solution, the higher the <. 
score. The 4+ Scoring Method is described in^-detail in the next section. 
Th^re^ are undoubtedly many* more methods for channeling attention upon! 
specific ideas, in" conjunction with EQUATIONS; imaginative teachers have 
already devised a number of them^'^ and m^ny more are likely to be forth- . 
qpming* • ^ ^ - t'* . < ^ - ' ^ 

■ ^ . ' , METHOD ^ 

Subjects * jms >;:\, ' . . 

' ' - . ^V' * 

The samples in these two. experiments* consisted of 37 sj^dents f rom • 
two eighth-grade classes at blague Junior Higli School in AnA A^bor, Michigan 
(a suburban university community) ^ and; 47 studeifts from two seVenth-grade ^ 



classes at Pelham Middie School in inper-city Detroit* ^They' were all the 
students .enrolled in the four classes for the full year '^for whom both prfetes*t 
and posttest scores couW be obtained. The Pelham classes » were hetero- 
geneous; the students were not selected in any way. At Clague the top 15 ^ 
percent of the eighth y^raders; are encouraged to enr9ll In an algebra olass^ 
rather t±ian' In one of^^e regular mathematics elasses. Other than^this, the y 
two,regui;&r msfthematic^ Classes at Clague in th^ study were heterogeneous — -/ 
and the students unselected. ^ * . ' / 



Experimental" Conditions ^ * * * 9\ 

Thejre was an exp.erimentaX class and a control •class chosen at each 
'school before pretests were administered. At each school the s^me 'teacher 
Jtaught both classes.' Both had experience in using' ^ EQUATIONS tourriamenf 
in their regular mathematics classes: th6 Detroit teacher, three years' 
experience; the Ann Arbor teacher, pne'*Vear. The control classe^s engaged 
in a regular EQUATIONS ^tourp^ment once a ^eek ^throughout the school year 
and had regular class es^,$Ke othex four dayS*. The experimental classes alsb- 
• engaged in an EQUATIONS tournament once a week' and had regular cJLass'es-the 
"(Xther four days, f^ut they u^ed the 4+ Scoring ^Method rather, than tiie regular 
•sopring method in their tournaments. Thus^ the* only known difference between* 
,the two classes at each .school was the method of scoring in the EQUATIONS 
game u^ed ln> their onpe-a-week tournament. play . ^ The^ teachers were the same, 
the amount of tournament play was the same, the amount of regular classroom « 
time was the. same, ;,^e iiiode of assignment of students to the classes being ~ 
'coii5>ared was. the same, and the average pretest scores were not signif icarftly 
different. ' , " ' . ' 

In the regular scoring for EQUATIONS the numbex of points that a C^' 
player receives in the* play of a complete game depends upon (a) whether 
he or the oth^r players sustain the burden of proof that there ds a Solution^ " 
and (b) whether he is the Challenger, the Mover, the Joiner, the Declarer, 
or an Other player. The ntimber of, points regular scoring ranges from-* • 
-1 to 2; .it is summarized in Table 1. ' • 

The number of points rec^ved by a placer in no Way 4epends,Mjqpon the 
characteristics pf the Splution chat he off^s. The only thing tliat matters 
is that it is a Solution; it does^not matter how simple or how sophisticated 
the mathematical ideas are ttiat the Solution exemplifies. ' _ 

The 4+ Scorfn^Hethod is jiist <Wosite\jL3fi this respect. A player's* 
score is highly dependent upon i:Hfe**chaTact;eristi<is of the Solution that ^ 
he or^she offers.,. A playej: can obtain up- to fouf^bontises depending iq)on 
how "interesting" the Solution offered is — hence, "the name: -4+ Scoring. . 



' Table 1 



'4^ 



Regular (R) Scoring 



Points. • 


. For What ' . - - ^ ^ 


2 


Win by Challenger, Mover of Mover- Joiner • / 


' > • : 


. .Win- by Challenger- Joiner or any player 'x<ho 
,builds a Solution in a Force-Out- 


0 . • ' 

i • . 
1 


Loss by any pl-ayer or failure of a playfet . 
other than the Force-Out Declarer - 
•Other player) to build a Solution, In a' 
Force-Out. • ' ^ 


. • "l 
* , > 


Failure of the Fprce-Out Decl.arer to^build 
a Solution in a^orcerOut*" 



What rashes a Solution "interesting*' is the set of matbemaf ical concepts that 
it exemplifies. In the A+ Scoring used in Ijhis study there arfe *23 different 
concepts for which bonxises may be obtained. Fqr example, a ptLayer gets a 
bonus of^il point if his Solution us^s the-coricept of exponentiation; 2 pqints 
if it uses the concept- of negative number ;^ 3 "points it it uses the Qoncept of. 
"division by a fraction; A points' if it uses 'the concept of a toot of *a 
fractfion; saxd 5 points ff it uses the cSiicept^of negative exponent* Thus ^ 
a Challenger who 6ff^d the Solution, At[3*(6-7}], for a Goal of 12 would 
receive fou^ bonusesAth^e* maximum number) totaling 11 pointy , and his total 
score for that * play /qf the* g^me woifld- be 13 points in accordance' \d.th the 
following A+ Scoring formula: • ' ' " • . 

' ' . A+ Score = (Regular Score) 4 (Up to, 4 Bonuse^ 



•^A ^ ^ '^^h 



4 bonuses 



13"= 2 + U 



2 
5' 
1 ' 
3 



1 



Negative number (6-^7) 

" Negative ^exponent (3**(6-7)) ^ 

Exponentiation (*) 

Division by a fraction (At [3*(6-7) ]) 



(In EQUATIONS the concept of exponentiation is denoted by an asterisk, - For 
exanrole 3*2 = 3 =^ 3 x .3 apjd 2*4 ^ 2 = 2x2x2x2.) It is possible for* a . 
placer ^to get up to 22 points 'on a a complete play>^<?f game, of* EQUATIONS; J * 
to get the maximum scqre he or^he would need t<© biiild a Solution that used" 



all fouTT^ of ' the^-point concepts* Of the 23 concepts foif whicli bonus^ points 
♦are available, five are 1-point concepts, five are 2-point concepts, five 
are.3~poitit concepts, four are Appoint concepts, and four are-S-poinf 
concepts • A],l 23 'concepts 'and their point value, as well* as detailed exempli- 
fication of each, are presented in the Appendix B» ^ - • 

\ ^ . • . ^ 

Ct' is perhaps worth emphasizing' that there is 'nothing special ab'out 
'the particulat 23 ideas that are presented In the version of 4+ Scjoring' 
used iri^ this study The. number of concepts for which bonus points wiH^ be. 
awarded, which concepts, and what point value can all be varied in accord v 
wltR jfliatr the classroojn teacher thinks is Important' and wants to focus 
attention *upon by; the; scoring. Thus *4-^ scoring highly flexible laeans . 
for channeling attention upon whatever mathematical concepts a teacher 
judges to be worth emphasis. . ' . • 

Dependent ^Variables , 

^ ' Thfe effects of the learning experiences of the experimental classes 
and the control classes were mepgured by f<^ specially-constructed series 
of pretests and four posttests. The first pair of- tests ^ were the same . 
type of C-tests,and R-test§ used in the IMP Kit studies; the latter ^ > 
consisted of 21* extremely difficult ,R-type problems invol,viTllg?«feth^ 21 concept^ 
presented In the IMP Kits plus four "throw-away'^, ^it^ms that were not counted 
in the scoring. There is close correspondence between these 21 concepts , 
and what is emphasized ,ln* the 4+ Scoring^ xised In thi^study; 18 of the 21 
are concepts for Vvhich boAuses were given. ^ An exampLe^ of_ an R-type problem 
is 'the following: ' - , ' * ' ^cIJa^^; ' r- ^ / 

' C6lumn A . \ - Column B . • ^ Columi^^ cf ^^ . YlES , NO 

(R) - - L 3 6 • 8 ^ • ' ' ' - . 

By writing .an X in the YES 6r NO column. Indicate whether or *no't all . 
i of xHCijL characters in CoXtuii, A xan be appropriately . ordered^ and grouped 
(inserting paientheses wherever necessary)- to forja an expression equal* 
to the number in Column ^B., If your, answer is YES ,^ write that ^expression 
In Column C • \ • ^ . v - • * . 

An sample of a C-type problem involving exactly the -same ',concept Is the 
foUoigLngf \' ^ • . • • . 



(c) ^-(1-3) = __?__• • , y" - , ^ 

.All that is iavolved in \ the C-type problem Is^ coraf^tf^dtoa ^i.e*^ 
an express ion. However, xd.tli the R-type problem,, m^^ptiij^"^^ computation ' 
"involved, Ijiit* the. problem-solver also struggles w±tri^ta|..^pect of ^'applying" 
an idea; he or she Uiist recognize somehow the relevance^ ttlf' the concg^^ of 
subtracting negative numbers for solving the p.robXfem. In -general, fdefi the » 



R-type and the^ C~type problems Involve tKe same concepts, th|4' Jl- type* seem • 
tq be about three times as hard as the C-type; students and teachers get 

%bout one-third as many^ R-type» problems correct as tfiey do of, the corresponding 
C-type problems* This first pair of tests, which had as* content the 21 \ 
cOTcepts of the IMP Kft^ presented Jn p- and RTtype teats, is referred, to * ' 
1x1 this study as the hard tests* The second pair ,of •tests, which ^liad simpler* 
content presented in C- and Retype tests, is referred to as , the ^easy, t:ests ♦ 

* The. content of the easy tests was the set pf ideas ecjphasized in thfe seveixth- : 
grade curriculum of Detroif schools : problems Involving addition, subtraction, 

^multiplication, and division of whole nximbefs^ ^fractions, and decimal 
expressions; ordering and 'grouping problems; arid percentage problems t There 
is very little. correspondence between the content *6f. the' easy tests and the* 
content; emphasized in the 4+ Scoring used in this atudy; only tihree o^ t|ie^ ; 
23 concepts for which bonuses were giveiji appear on the ea^sy tests.' ^Thus th^ 
hard testtf wete ^content specific to ..the 4+ Scoring* userd in this study; -the** 
easy tests were not* • ' ' - .* ^ \ \ ' . ' 

TX/0 forms of each of the four tests were adqiinisteredj half of each T 
form as* pre'tests and the ojzher half as- posttests; *A11 of the easy tests 
were adminieiiered before" the' hard i:ests at ,bOth''prjetesting and posttesting. 
!rhe orde^ of " administering the. C~tests iand the R-*t^9ts* and the; forms foif ^ ' • 
^both the easy tests and the h^td t^sts was , balanced by dividing the samples 
intQ* eight -^rdups and administering as follows: . 

■ Order of , " * . 

^ - ^ / • , * . . ■ Administration. Gl G2 G3 G4 G5''G6 G7 G8 , \ , 

Pretext ^ 1. • .CI CI R1,R2 C2 C2 *RI R2 " 

V ■ - . 2 - Rl R2*C1 CI Rl R2 C2 fcr n' 



; Posttest 1^ \ R2 Rl C2-C2 R2 Rl CI. 01 • : ^ 

. \\ • . ^ '/^ • C2 C2 112 RlCl Ci R2. Rl . 

• \ . . . - . ' ^ ^ ' 

Usiftg'cCa (after) to d*enote the store on the C posttest and Cb ^(bef ore) -1:p 
denote the C pretest score (and* similarly for tfte^R'-posttests. mid pretests), 
outcome measured of sik dependent variables can be specif ied for the easy 
tests and the hard t^^sts. for each pair o^^^ classes separately aad for tiie ^ * 
■ coiriblnation of both pairs -as 'follows : . ( ' ( ' ' * ^ 

• ^ ^ Cb •" C" protest score . ' • . , , * * 

]^;/ *• R pretest score ^ « . / 
.* ^ Ga ^C posttpst* score ^ - . * 

Ra \ / • R posttest score'- / "X ' - • 

'\ Cg<t«' ^C-.^aln score (Cg Ca-Cb) *" \ , • 

* Rg *R:"gain'SC9re (Rg » Ra-Rb) . . ' 
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Differences between B^eriifiental (4+. Scoring)' and Control (Regulai: Scoring) 
Classes on Pr-etest, Posttest, and Gain Scores foj; bbtli Easy^and Hard VersiTOj^is 
of C Tests and R Tests at Seventh and Eighth Gtade Levels and Both. Combined // 
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Cn Ex 
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; I } • ^ Cn = Control classes .^.^ Z 
j3" * BB/"*^^ = E3q?eifimental^ 'classes; 
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- » ND;^signif icant difference.. • / - - 

X « Significanca level of ;3ifferences in posettest scores.. 



- ^^^^^^^^^^^ 



Posttest . . 

score --^ ---l-- 

^^Score*'^!' y^ =? /Significance ievej. of differences In gain, scores. * 
Pretest" ^/ ' I _ ^^.... H- /' 

Sqpre/? — ^It^^t/^' z <S^y|nif icancfe level of differences, in prete'st "scores 



' " ' ^ ^ . * RESULTS * ^ ^ *• 1, • ' 

•the descriptive statistics ^o'j: p.retests, posfctests, and gatucsqores on 
both tl»e easy and hard versions of the^ C tests and .R tests fo'T'ia^e'^ experi- • 
mental classes with the 4+ Scoring anH the control classes \d.th regular . 
scoring are summarized in Figure 1 for the seventh ^ad'e classes/, ^e eighth 
grade*ccl,asses, and for both combined* The combined results, in /vhcich* J:he 
sample sizes. oJ the experimental and control groups are about 40^ subjects 
as^opposed' to half that tor the individxial grades, ^are more^ Intfereatlng 
in showing the contrast' in performance gains betweeai the '4+ scoring * 
claasfes and the .rtegular scoring classes. - / , ^ 4 ^ - 

* ' * *. 

, A graphic representation, of the mean pret'est, postVest, and ^In scores, 

as well as significant differences between the experimental and coi^tral 

classes on these jneasures, is als6 presented in Figure 1. 

On pretest scores there were no significaAt differences between the. ^ 
experimental .and control c],a6ses on either the hard tests or the easy tests 
for either the C tgsts or the^ R^ tests for the seventh grade, the eighth grade, 
or the combindd 'clas^ies* The Student, 1; (one-tailed) test was Used through- 
f out to coispare the performancS of the 4+^ Scoring classes with the control 
' classes,. Those that are significant at a confidence level of less than .01^ 
are being/ charaqterized here "as strongly significant; at less than .05, 
as significant; at less than .10, , as weakly' significant.^ ♦ 

On posttest scores on the C tests, thfe scores of the eighth grade 
4+ Scoring class on the ea^ test (7ere weakly significantly higher (.08 level) 
and the scores of the 4+ Scoring classfes- on the easy C posttest^ for both 
grades Combined 10.8, while for the control classes it W54s On 
the hard g posttests the scores bf the 4+ Scoring classes were higher , at each 
grade level and fot both combine?; they were weakly .significantly • higher j 
(.07 leVel)' for the seyenth grade classes, strongly significantly, higher 
(.009 level) for the eighth grade, and»sti;ongly significantly higher (.003 
level) for both coicbined.. The mean' sccrr^ for the 4+ Scoring classes on the 
hard^C posttest for both ^ades combined was 6.6 whrile for the control c5la£ses 
it was 4.7. • ' r ; ' * . • ^ 

tije gain scores for the C tests the only scores of the 4+^ Scoring 
class that were significantly higher than^^e control classe? on th^ ea^y 
tests, were those for the combined grades, and ^ they were 6nly^^'v?eakly signifl- ^ 
cantly higher '(•09 levelO . However, on the hard, tests, both * the ^bcores for 
.th.e eighth #^ade aili fo^ ^'^^ combined gyades werfe- strongly si^aif icantly 
higher (^002 and .003 levels, respectively) than the coirrespcnding ooiatrol 
classes. T?he mean gains, for which there was ^ a significant dlff erepcevon, ^ 
^the^ksy tests, were 2.5 for the 4+ Scoring classes and^^l.S for the coi^Erbl 
clalies. On the hard tests 'flie mean gains for tlje eighth grade classes were 
4.3 and 1.3| and -for the combined classes they ^ere 2.8*and 1^0. " Theite* were 
no other significant' differences "between the expertmejatal and control 
'blas'ses on the C*-test scores. /"K^ * * ' ^ 
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' On the post test scoTes for the R tests the;results were similar to 
'those for the t; test? on the easy iiests, except that the seventh grade had 
the'weakly significant -result rather than the eighth grade,. The-scores of 
the sevefith ^rade 4+ Scoiing 3feass wet^ weakly signif icaiitly higher (.06 ' 
level) than those of the jtiontrol) class and the scores ot the combined ,4+ 
Sqpririg classes were significant/ly higher <.04 level) than tha6e of the 
control classes. The me^'scor^ for the^ seventh grade were 6.6 and 4.7'- 
while for the combined grades they" were 6.8 and 5.3. On^the hard tests^Jonly 
tw6 of the R posttest differences were significant. . ,The scopes of the eighth , 
grade 4+ Scpring class wre . significantly higher (.05 level) than those of 
the control class, and the score's of the combined 4+ 'Scaring classes were 
significant ly higher (.03 than the con ttbL classes. 
\ \ » ' ' ^ 

On th^qgain scores for the R tests two ^differences were wi? 
significant on the easy^ tests.- The scores of the seventh grade *4+ Coring 
class ^were weakly significantly higher (.10 levelT than those of the control 
class, and -.the scores of the combined 4+ Scoring classes were Weakly signifl- 
•cantly higher (.10 level) than those of the control classes. On the hard 
tes^s^ all thtee differences were significant.' The scores of the seventh . 
grade; eighth -grade, and combined 4+ Scoring classes were' significantly .( .04 
level), signifiQan£ly (.02 level), ^ an4 strongly significantly (.003 level) * 
higher* than those of the respective control classes • , ' ' • 

Trtie *po6t interesting of these results, the differences In^thd meastnre 
"of increase in performance (the gain scores)^- show up most clearjy In the 
combined resulta for both grades summ^ized In Table 2. The differences in 

\ ' Table 2 



Comparison- on C Tests aAd R.J^sts of the, Significance Levels of 
the Differences in G^ihs Bety^een. the 4+ Scoring Classes and the 
Control glasses on the Easy Tests and the 'Har^' Tests / ° 


.Tests 




, Hard 
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• R ''• 

' ■ ■ r' 


Weakly ^ 
significant 
^ p < ..10 o 
• 

Weal^y 
significant 
^ p < .10^*: V- - 


, Strongly 
significant 
' p < .003 

'\ ^ ^ 
Strongly ^ 
significant - . 
^ .p < .003 

_« _ , Si 



. gains between the 44:,St!bring tlasses and the control classes on both the 
C tests and the R tests were weakly significant on the. easy tests, l3Ut\ they 
were strongly significant on tl^ hard tests ^that'tSrere content-specific to 

. the 4+ Scoring. ^ ' 7 ; > ' ' . " . . 
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DISCUSSION 



* What deserves special emphasis abdut these experiments is the / 
support they lend to the proposition that .when ^t^dents are .involve^! 
and enthused, a relatively mijior *chang^<e can prod^e profound diffet^^naes 
in the amouAt learned. The students ^n both the^ ^control and experli- 
mental classes were highly motivate'd in their participation in the 
EQUATIONS tournaments. The 4+ scoriifg is a relatively -minor modiilca^ ' 
tioa of ^he* conventional scoring^ method; by means of 4+ scoring the- 
placers can obtain bonus points for an intetlnediate score which det^ey- 
mines their -ranking with respect to th^^other players in their game, ^ 
which tn turn determines their uitiltiate score for that day's play iu 
the tournament. • For the ultimate 3.c6re in the game at each table,' » 
12 points are*divided amon^ the three players: 6 to the high ^Scorer, 
2 to the low scorer; and 4 to the middie person. ^Thus, ranking is" . 
what IS significant in determining the ultimate score, not the magni-- 
tude of the intermediate scor&; .but where 4+ scoring differs most 
from the regular scoring is merely in its effect upon the magnitude 
of the intermediate score, not' in effect tipon the ranking. Yet •this 
seemingly inconsequential chanjge in the intermediate scoring (iff term^ 
of the ultimate scoi:es of the ^game) produced on the* tests that are of 
the* greatest interest (the hatd R tests) gain scores in the eighth- 
grade 4+ scori^ag (^a^ssfes"^ that were nearly »thre^ times as great as thS 
regular scoring classes and ga^ns ±<i the seventh-grade 4+ scoring 
clas3B9 ^hat ^ere nearly double those in .the regular scoring classes^ 
*^he ^ tfests are a measure of the learner/ s ability to recognize the 
relevance of a concept for solving' a problejn in addition to the . 
ability to ^do 'computations* that' invplVe the concept,.* This .abTLity ^ 
to discriminate .'^hat is relevant is one aspect of "applying" ^deas ,in 
solving problems. That' on this R-type m^sijre the magnitude of the* 
relative difference -in ^chieveftient elicited by sucli seemingly minor 
modification of procedure is so great is indeed surprising. It seems 
to be grounds for optimism about the potentialities improving 
learning processes, by channeling attention appropriately. Irf the. 
context of ^ recreational cognition-enhancing activity such as these 
EQUATIONS tournaments, attentionrchanneling techniques appedr to be 
highly effective for increasing capability. ^to discriminate wh'at is 
relevant in mathematical problem-solving. They should *be lised more, 
and they* deserve to be studied^more. / 
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